APPARATUS AND METHOD FOR CALCULATING SIMULATION COVERAGE 



CROSS-REFERENCE TO RELATED APPLICATIONS 
This applxca-blon Is based upon and claims -the 
benefit: of priority from the prior Japanese Patent 
Application No . 2002-225523 , filed on August 2, 2002, the 
entire contents of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

The present invention relates to an apparatus 
and a method for calculating a simulation coverage, and 
more particularly to the apparatus and the method tha-t are 
arranged to calculate a simulation coverage for a logic 
circuit through the use of a computer. 

(2) Description of the Related Art 

Today, the system LSI (Large Scale Integrated 
Circuit) has been made higher in function and greater in 
logical scale, so that the verification in designing such 
a system LSI may become longer and longer. For the design 
verification, as an index to a complete verification, a 
coverage is used. 

The coverage is basically calculated on the 
basis of the number of lines executed by the design 
simulation, included in all lines described in a hardware 
description language (referred to as a HDL) . This kind of 
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coverage is called a line coverage. 

However, the line coverage, that is, the 
conventional verifying method has no concept of time, 
concretely, no concept of when a certain line is executed. 
5 Hence, even though the line coverage ratio reaches 100 %, 
disadvantageously , it does not necessarily mean the 
effective design verification. 

Hereafter, this disadvantage will be concretely 

described. 

10 Fig. 7 shows an exemplary description of a HDL. 

Further, Fig. 8 is a circuit diagram showing a 
circuit designed in the HDL description shown in Fig. 7. 

In Fig. 7 and Fig. 8, the block A described in 
the HDL corresponds to a circuit 50, the block B 
15 corresponds to a circuit 51, and the block C corresponds 
to a circuit 52, each of which circuits is composed of a 
flip-flop, for example. 

Hereinafter, the description will be e3q>anded 
along the case that the circuit shown in Fig. 8 is 
20 verified . 

In Fig. 8, P, Q, EN, OUT, a, and b denote signal 
names , respectively . 

Each of the blocks A, B and C includes a 
description of ^^always @ (posedge CLK) begin'' and is 
25 started on the rise of a clock signal (not shown) . In the 
circuit 50 described in the block A, if P = 1, a = al is 
outputted, while if not, a = a2 is outputted. In the 
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circuit 51 described In -the block B, If Q = 1/ b = bl Is 
outputted, while if not, b = b2 is outputted. Further, in 
the circuit 52 described in the block C , if EN = 1 , OUT = 
a&b is outputted, while if not, OUT = 0 is outputted. 
5 Fig. 9 shows test patterns that are effective in 

verifying the operation of the logic circuit shown in Fig. 
8. 

For the logic circuit shown in Fig. 8, four 
effective test patterns may be provided, that is, a 
10 pattern (1) , a pattern (2) , a pattern (3) , and a pattern 
(4) as shown in Fig. 9, in which ^^-^^ indicates any value 
of 0 and 1. 

Herein, the description will be oriented to the 
case that the following test patterns are entered by the 
IS user. 

Fig. 10 shows an example of the test patterns 
entered by the user. 

In a case that the user enters the patterns a 
and P for verifying the logic circuit shown in Fig. 8, the 

20 pattern a covers the lines (1) to (4) and (6) shown in Fig. 
7, while the pattern fi covers the lines (1) to (6) shown 
therein. It covers all lines. Although it means that only 
the pattern P is the effective one of the test patterns 
shown in Fig. 9, the resulting line coverage ratio reaches 

25 100 %. This is not the complete verification. 

SUMMARY OF THE INVENTION 



3 



The present Invention Is made In consideration 
of the foregoing respect. It Is an object of the present 
Invention to provide a simulation coverage calculating 
apparatus that Is arranged to calculate such a coverage as 
5 ijiiplementlng a sufficient verification. 

It Is the other object of the present Invention 
to provide a simulation coverage calculating method that 
Is arranged to calculate such a coverage as Implementing a 
sufficient verification. 

10 Xn order to achieve the first object, the 

simulation coverage calculating apparatus Is provided for 
calculating a simulation coverage for a logic circuit. The 
simulation coverage calculating apparatus Includes a first 
Input unit reading a property that represents one or more 

15 effective test patterns to the logic circuit to be 
verified; an effective test pattern calculating unit 
calculating one or more effective test patterns based on 
the property; a second Input unit reading a test pattern 
entered and executed by a verifier; a coverage ratio 

20 calculating unit calculating a coverage ratio from the 
ratio of the number of the executed test patterns matched 
to the effective test patterns to the number of all the 
effective test patterns; and an output unit outputtlng the 
calculated coverage ratio. 

25 In order to achieve the second object, the 

simulation coverage calculating method Is provided for 
calculating a simulation coverage for a logic circuit 
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1:hrough "bhe use of a compu'ter. The sdLmula'bxon coverage 
calculat:ing met:hod includes -bhe steps of reading a 
property that represents one or more effective test 
patterns to the logic circuit to be verified; calculating 
5 the effective test patterns based on the property; reading 
one or more test patterns entered and executed by the 
verifier; and calculating a coverage ratio from a ratio of 
the number of the executed test patterns matched to the 
effective test patterns to the number of all the effective 

10 test patterns. 

The above and other objects, features and 
advantages of the present Invention will become apparent 
from the following description when taken In conjunction 
with the accompanying drawings which Illustrate preferred 

15 embodiments of the present Invention by way of example. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 Is a function block diagram showing a 
simulation coverage calculating apparatus according to an 
20 embodiment of the present Invention. 

Fig. 2 Is a table showing an example of test 
patterns entered by a user. 

Fig. 3 Is a flowchart showing a method for 
calculating a simulation coverage. 
25 Fig. 4 Is a diagram showing a hardware 

arrangement of the simulation coverage calculating 
apparatus . 
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F±g. 5 Is a block diagreun showing an example of 
a logic circuit to be verified. 

Figs. 6A, 6B, and 6C are tables showing effective 
test patterns to the logic circuit shown in Fig. 5, in 
S which Fig. 6A shows patterns of Q, and S, Fig. 6B 

shows patterns of ENl and EN2 , and Fig . 6C shows patterns 
of OUTl and OUT2 . 

Fig. 7 is a view showing an exemplary 
description of a HDL. 
10 Fig. 8 is a circuit diagram showing a circuit 

designed in the HDL description shown in Fig. 7. 

Fig. 9 is a table showing test patterns that are 
effective in verifying the operation of the logic circuit 
shown in Fig . 8 . 

IS Fig. 10 is a table showing an example of test 

patterns entered by a user. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Hereafter, the embodiment of the present 
20 invention will be described with reference to the appended 
drawings . 

Fig. 1 is a function block diagram showing a 
simulation coverage calculating apparatus according to the 
embodiment of the invention. 
25 A simulation coverage calculating apparatus 10 

includes an input unit 11 of reading a property that 
represents effective test patterns to a logic circuit to 
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be verified, an effective tes^ pa-b-bern calculating unit 12 
calculating the effective test patterns based on the 
property, an Input unit 13 reading test patterns entered 
and executed by a verifier (called a user) , a coverage 
5 ratio calculating unit 14 calculating a coverage ratio 
from a ratio of "the number of the execu-ted test patterns 
matched to the effective test patterns to the number of 
all the effective 'test patterns, and an output unl't 15 
outputtlng -the calculated coverage ratio. 

10 The Input unit 11 reads a property which 

represents an effective test pa-tterns to a logic circuit, 
and which Is supplied by, for example, a designer of the 
logic circuit to be verified. 

The effective test patterns are test patterns 

IS selected from all operation patterns of the logic circuit 
and the execution of only the selected test patterns 
results In reaching a complete verification. The details 
of the effective test pattern will be described later. 
Ordinarily, a person who designs the logic circuit knows 

20 this effective test pattern. However, It Is hard for the 
-third person, for example, the user who verifies t:he logic 
circuit, to know It. Hence, the designer, for exaxEiple, 
supplies a represen-tatlon of the effective test patterns 
as a property. 

25 For the circuit shown In Fig. 8, as described 

above, the effective test patterns are those shown In Fig. 
9 . The supplier of the property represen-ts the effective 
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-bes-t pat:terns by means of an expression represented as 
follows . 



[(P, Q)] [EN = = 1] ... (1) 

5 

In -this expression, (P, Q) means a combination 
of P and Q. EN = 1 signifies that EN Is 1 . [] signifies 
that It Is a delimiter of a cycle. That Is, [(P, Q) ] 
Indicates a time t and [EN =r = 1] Indicates a time t+1 . If 
10 a signal Is not descrdLbed In [] , It may take any signal 
value . 

The effective test pattern calculating unit 12 
operates to calculate the effective test patterns to the 
logic circuit based on the property corresponding to the 

IS logic circuit to be logically simulated. The Input unit 13 
operates to read the test patterns entered and executed by 
the user who simulates the logic circuit. The coverage 
ratio calculating unit 14 operates to detect the degree of 
agreement between the effective test patterns calculated 

20 by the effective test pattern calculating unit 12 and the 
test patterns entered and executed by the user and then 
calculate a coverage ratio from a ratio of the number of 
the executed test patterns to the effective test patterns 
to the number of all the effective test patterns. The 

25 output unit 15 has a function of outputtlng the coverage 
ratio calculated by the coverage ratio calculating unit 14 
to a display unit 20 or the like. 
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The descrip-blon will be orlen-bed "to -bhe 
operat:lon o£ "the simula^xon coverage calculat:±ng appara'tus 
10. 

Hereafter, t:he circuit: shown In Fig. 8 will be 
S described along t:he case of calcula'blng a coverage. 

The property represented In -the foregoing 
expression (1) that represents the effective test patterns 
to the logic circuit shown In Fig. 8, supplied by, for 
example, the property supplier such as a designer. Is read 

10 Into the Input unit 11. Then, the effective test pattern 
calculating unit 12 operates to calculate the effective 
test patterns as shown In Fig. 9 based on the property. 

On the other hand. In a case that the test 
patterns for simulating the logic circuit shown In Fig. 8, 

IS entered and executed by the user, are read Into the Input 
unit 13, those test patters are entered Into the coverage 
ratio calculating unit 14 In which the coverage ratio Is 
calculated. The calculation of the coverage ratio Is 
executed by the process of detecting how many of the 

20 executed test patterns are matched to the effective test 
patterns shown In Fig. 9 and calculating a coverage ratio 
based on a ratio of the number of the executed test 
pattern (s) to the effective test patterns to the number of 
all the effective test patterns . 

25 In a case that, for example, the test patterns 

shown In Fig. 10 are entered, the conventional line 
coverage reaches a coverage ratio of 100 % . On the other 
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hand, i:he simulation coverage calculating apparatus 10 
according to this embodiment of the invention indicates a 
coverage ratio of 25 % because only the pattern P 
corresponds to the effective test pattern (4) . 
5 The calculated result is outputted by the output 

unit 15 to the display unit 20. 

The user finds out a lack of the effective test 
pattern as viewing the displayed result and adds new test 
patterns . 

10 Fig. 2 shows an example of the test patterns to 

be entered by the user. 

These test patterns are the addition of patterns 
6/ and 8 to the patterns a and P shown in Fig. 10. In 
this case, the pattern P corresponds to the effective test 

15 pattern (4) shown in Fig. 9, the pattern y corresponds to 
the effective test pattern (1) , the pattern 6 corresponds 
to the effective test pattern (2) , and the pattern e 
corresponds to the effective test pattern (3) . Hence, the 
coverage ratio calculating unit 14 operates to calculate a 

20 coverage ratio of 100 % . The result is outputted by the 
output unit 15 to the display unit 20. The display unit 20 
displays that the coverage ratio reaches 100 % and thus 
the verification is complete. 

In the simulation coverage calculating apparatus 

25 according to this embodiment, as described above, the 
effective test pattern calculating unit 12 calculates the 
effective test patterns to the logic circuit to be 
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verified, based on -the proper t:y thai: represen-ts -bhe 
effective test patterns to the logic circuit entered in 
the input unit 11 with the combination of signals and the 
time information. Then, the coverage ratio calculating 
5 unit 14 calculates a coverage ratio from a ratio of the 
number of the user' s entered and executed test patterns 
matched to the effective test patterns to the niimber of 
all the effective test patterns . The simulation coverage 
calculating apparatus enables to execute a complete 
10 verification for the logic circuit. 

Hereafter, the simulation coverage calculating 
method through the use of the simulation coverage 
calculating apparatus 10 will be described along the 
flowchart . 

15 Fig. 3 is a flowchart showing the method for 

calculating a simulation coverage. 

SI: Read a property. 

The property that represents effective test 
patterns to a logic circuit to be verified is read into 
20 the input unit 11. 

S2 : Calculate effective test patterns . 

Based on the read property, the effective test 
patterns are calculated by the effective test pattern 
calculating unit 12 . 
25 S3 : Read test patterns . 

The test patterns entered and executed by the 
user are read into the input unit 13 . 
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S4 : Calculate a coverage ratio . 

The coverage ratio is calculated from the ratio 
of the number of the test patterns matched to the 
effective test patterns to the ntimber of all the effective 
S test patterns by the coverage ratio calculating unit 14 . 

As described above, the simulation coverage 
calculating method according to this embodiment takes the 
steps of entering a property that represents effective 
test patterns to the logic circuit with the combination of 

10 signals and the time information as indicated in the 
expression (1) , calculating the effective test patterns of 
the logic circuit to be verified based on the property, 
and calculating a coverage ratio from a ratio of the 
number of the user' s entered and executed test patterns 

15 matched to the effective test patterns to the number of 
all the effective test patterns . This method thus reaches 
the complete verification. 

Hereafter, this embodiment of the present 
invention will be described in detail . 

20 Fig. 4 is a block diagram showing the hardware 

arrangement of the simulation coverage calculating 
apparatus . 

The simulation coverage calculating apparatus 
may be a personal computer, for exeunple. It is arranged to 
25 have a CPU (Central Processing Unit) 31 for controlling an 
overall apparatus, a group of memories such as a ROM (Read 
Only Memory) 32 and a RAM (Random Access Memory) 33, a HDD 
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(Hard Disk Drive) 34, an Input: Interface 35, and a graphic 

lnt:er£ace 36 connected through a bus 37. 

The CPU 31 controls the overall apparatus and 

serves to execute programs stored In the HDD 34 or the ROM 
5 32 . It executes the processes that correspond with the 

effective test pattern calculating unit 12 and the 

coverage ratio calculating unit 14, respectively. 

The ROM 32 stores a firmware or the like 

required for starting the HDD 34 . The RAM 33 temporarily 
10 stores at least part of an OS (Operating System) program 

on which the CPU 31 Is executed and application programs . 

The HDD 34 stores the OS, a program for simulating the 

logic circuit, a program for executing the simulation 

coverage calculating method of this Invention, and the 
15 property that represents the effective test patterns to 

the logic circuit, supplied by the designer, for example. 

The Input Interface 35 Is connected with a mouse 

35a and a keyboard 35b. This Interface 35 transmits the 

signals sent from the mouse 35a and the keyboard 35b to 
20 the CPU 31 through the bus 37. It corresponds with the 

Input units 11 and 13 of the simulation coverage 

calculating apparatus 10 shown In Fig. 1. 

The graphic Interface 36 Is connected with a 

monitor 36a. The graphic Interface 36 displays an Image on 
25 the monitor 36a In accordance with the Instructions from 

the CPU 31. It corresponds with the output unit 15 of Fig. 

1. 
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Hereaf'bezr, -the descrlp'tion will be orlezi'ted t:o 
t:he operation of the simulation coverage calculating 
apparatus 30 . 

Fig. 5 shows an example of the logic circuit to 
S be verified. 

The logic circuit Includes two logic circuits 
each of which Is shown In Fig. 8. Each output OUTl or OUT2 
of these logic circuits Is applied Into the circuit 46. 

Each of these circuits Is composed of a fllp- 
10 flop and the like. 

In Fig. 5, P, Q, R, S, ENl, EN2, OUTl, 0UT2 , OUT, 
a, b, c, and d all denote signal names, respectively. 

Though the HDL description Is not described 
herein, the circuit 40 outputs a = al If P = 1 or a = a2 
15 If P = 0. The circuit 41 outputs b = bl If Q = 1 or b = b2 
If Q = 0. The circuit 42 outputs c = cl If R = 1 or c = c2 
If R = 0. The circuit 43 outputs d = dl If S = 1 or d = d2 
If S 0. The circuit 44 outputs OUTl = a & b If ENl = 1 
or OUTl = 0 If ENl = 0. The circuit 45 outputs OUT2 = c & 
20 d If EN2 = 1 or OUT2 = 0 If EN2 = 0. The circuit 46 
outputs OUT = OUTl & OUT2 . These circuits are Inputted 
with clock signals (not shown) and are started on the rise 
of the clock signals . 

Fig. 6 shows effective test patterns of the 
25 logic circuit shown In Fig. 5, In which Fig. 6A shows the 
patterns of P, Q, R and S, Fig. 6B shows the patterns of 
ENl and EN2 , and Fig . 6C shows the patterns of OUTl and 
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OUT2. 

In Fig. 6, ^^-'^ denotes any value of 0 and 1. 

Ordinarily, the effective test patterns as shown 
In Fig. 6 are arranged by the designer who designs the 
logic circuit. This Is because the third person rather 
than the designer of the logic circuit has difficulty in 
grasping the middle signals except the input signals when 
verifying the logic circuit. For exaxnple, in the logic 
circuit shown in Fig. 5, assuming that R, S, ENl , 

and £N2 are the input signals, the middle signals OUTl and 
OUT2 cannot be normally grasped. Hence, it is quite 
difficult to create the effective test patterns of all the 
signals including the middle signals. On the other hand, 
the designer of the logic circuit has a full knowledge of 
the signals passing through the logic circuit. It is thus 
preferable for the designer to take the responsdLblllty of 
creating the effective test patterns. Hereafter, therefore, 
the description will be es^anded assuming that the 
effective test patterns are created by the designer of the 
logic circuit. 

The designer creates a property based on the 
arranged effective test patterns. 

For the effective test patterns shown in Fig. 6, 
the property is represented by the following expression. 

[(P/ Q, R, S)] [ENl & EN2] [OUTl | OUT2] ...(2) 
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In this expression, the first [] signifies a 
time t, the next [] signifies a time t+1, and the last [] 
signifies a time t+2. [(P, Q, R, S) ] Indicates all 
combinations of P, Q, R and S, which are as shown In Fig. 
S 6A. [ENl & EN2] signifies a logical product (AND) of ENl 
and EN2 and [OUTl | OUT2] signifies a logical sum (OR) of 
OUTl and OXJT2 , each of [ENl & EN2] and [OUTl | OUT2] 
representing the effective test patterns as shown In Fig. 
6B and Fig. 6C. The signal that Is not described In [] may 

10 take any signal value. The designer enters the e3q>resslon 
(2) Into the simulation coverage calculating apparatus 30 
through the Input Interface 35 with, for example, the 
keyboard 35b or the mouse 35a. The entered property Is 
Inputted Into and stored In the HDD 34 under the control 

15 of the CPU 31. 

The property may be inputted on a recording 
medium such as a CD-ROM (Compact Disc Read Only Memory) or 
a DVD-ROM (DVD Read Only Memory) or the simulation 
coverage calculating apparatus 30 through a network like 

20 the Internet. 

In simulating the logic circuit, the user enters 
an Instruction for Indicating the start of the simulation 
with the mouse 35a or the keyboard 35b. The Input 
interface 35 receives the instruction and then starts the 

25 logic circuit simulator stored in the HDD 34 under the 
control of the CPU 31. The started logic circuit simulator 
is processed by the graphic interface 36 under the control 
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of -the CPU 31 and 'then outputs-bed to 'the monitor 36a. 
Furt:her, for example, the logic circuit used for the 
simulation is displayed on the monl-bor 36a as shown in Fig. 
5 . The user enters some test patterns in this logic 
5 circuit with the mouse 35a and ^he keyboard 35b and then 
simulates the operation under the control of the CPU 31. 
The user checks the simulated resul-t on the monitor 36a 
for verifying if a bug is found. 

Further, the simulation coverage ratio is 

10 calculat:ed by 'the following method. 

In the case of verifying -the logic circuit shown 
in Fig. 5, -the property (that is, the expression 2) that 
represents the effective test patterns of the logic 
circuit shown in Fig. 5 is read from the HDD 34 under t:he 

IS con-trol of -the CPU 31. The effective test patterns to the 
logic circui-t are calculated based on this property. Thus, 
the effective test patterns as shown in Fig. 6 are 
obtained. For example, these effective test patterns are 
t:eiaporarily stored in the RAM 33 . The test: patterns 

20 entered and executed by the user are compared with -the 
effective test patterns under the control of the CPU 31 . 
Then, the coverage ratio is calculated from a ratio of -the 
tes't pa-tterns matched to the effective -test pat:terns. 

More particularly, when the user enters a 

25 certain signal for test in the logic circuit, for example, 
the CPU 31 monitors at the states of the signals of 
various units including the middle signals the user cannot 

17 



easily grasp and compares the test patterns of all signals 
including the middle signals with the effective test 
patterns, for calculating the coverage ratio. 

The calculated coverage ratio is processed by 
5 the graphic interface 36 and then is outputted onto the 
monitor 36a. The user refers to the coverage ratio 
displayed on the monitor 36a. If the coverage ratio is low, 
the user adds further test patterns . If the test patterns 
entered by the user agree with the effective test patterns, 

10 the coverage ratio reaches 100 %. This is the end of the 
verification . 

As set forth above, the simulation coverage 
calculating method according to this embodiment is 
arranged to enter the property that represents the 

15 effective test patterns of the logic circuit to be 
verified with the combination of the signals and the time 
information as indicated in the expression 2 before 
simulating the logic circuit and to calculate the coverage 
ratio from a ratio of the number of the user' s entered and 

20 executed test patterns matched to the effective test 
patterns to the number of all the effective test patterns 
calculated on the property. This makes it possible to 
execute the complete verification. 

According to the present invention, the coverage 

25 ratio is calculated from the ratio of the number of the 
test patterns matched to the effective test patterns to 
the number of all the effective test patterns, based on 
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"the proper -by 1:hai: representis tiie effecblve -test: pat.tierns 
-bo -bhe logic circux-b bo be verified wlt:h 'bhe comblna'blon 
of bhe signals and bhe -blme Informablon. The preseni: 
Inven'blon bhus realizes lihe complete verification. 

The foregoing Is considered as lllus-bra-blve only 
of bhe principles of 'bhe presen'b Inven'blon. Fur'bher, since 
numerous modlf Ica-blons and changes will readily occur bo 
those skilled In the arb, lb Is not considered to limit 
the Invention to the exact constonictlon and applications 
shown and described, and accordingly, all suitable 
modifications and equivalents may be regarded as falling 
within the scope of the Invention In the appended claims 
and their equivalents . 
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